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PREFACE 

The Bucks County Schools have for some time been committed to 
improving the quality of the educational offerings for its youth. Char- 
acteristic of that commitment was the manner in which officials of the 
Pennsylvania Department of Education, Bucks County Public Schools, Luzerne 
County Public Schools, Allegheny County Public Schools, Penn-Trafford 
School District, Pittsburgh School District, and Erie School District 
Joined together in 1966 to draft the proposal for the Quality Education 
Program Study (QEPS). Cpnceived as a complement to Pennsylvania's 
pioneering efforts to assess the quality of its schools, the study „as 
designed to define and clarify the Ten Goals of Quality Education adopted 
by the State Board of Education In 1965. 

The following booklet is a part of the story of how Q.E.P.S. 
went about its ambitious task, and the results of that effort. We trust 
this statement of the behavioral definitions for Pennsylvania's Ten Goals 
of Quality Education will serve as a guide for the evaluation and improve- 
ment of teaching and learning in the schools of the Commonwealth. 



Dr. George E. Raab 
County Superintendent 
Bucks County Public Schools 



Hi 






I INTRODUCTION 

1 , 

I In recent years there has been an Increased Interest in goal 

I definition in education. Most efforts toward the establishinent and 
; definition of goals seems to take the form of generalizations or descrip- 

tive statements. Little, if any, data is available concerning empiric.U 
methods for defining educational goals. 

Until recently, the "Goals for Quality Education" were not 
! defined in a coherent form. An analysts of this problem revealed that 
most stated goals have little exact meaning for the practicing educator. 
Frequently, goals are stated In such general terms that any educator 
could convince himself that these goals are the purpose that guide his 
; program. Goals are statements of general educational intents. While 
I it is not absolutely necessary for goals to be stated in performance 
1 terms, the more clearly these statements are described, the more readily 
we can develop valid indicators of pupil behaviors 

The first step in constructing an instructional program centers 
I upon the need for a set of objectives. An objective refers to the per- 
j formance or change in behavior a pupil is to exhibit upon completion of 
: instruction. Therefore, meaningful objectives should relate to the 
; "Goals for Quality Education". If one is "to measure objectively the 
I adequacy and efficiency" of educational programs, these objectives must 
. be described in terms of not what the schools do, but in what children 
■ do. One must itemize the kinds of behavior that add up to the goals for 
; quality education if we are ever to know how children progress toward the 
i goals or how efficient an educational program may be in furthering such 
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progress. Specifying gosls In this wsy poses prsctlcal problems.^ 

The formulation and adoption of Pennsylvania's Goals of Quality 
Education represents a major step toward the definition of the State's 
educational Intents, making possible an .issessment of its efforts toward 
the fulfillment of those Intents. In an effort to further Increase the 
utility of the goals to the practitioner and evaluator, the Quality 
Education Program Study was proposed to review, define, and clarify the 
Ten Goals. Funded In 1968 under E.S.E.A. Title 111, Q.E.P.S. made a 
unique departure from the usual "armchair philosophy" or logical approach 
to goal definition by deciding to employ the Critical Incident Technique. 
This technique was used to collect empirical data to define the goals. 

The QET^ staff collected critical Incident data from teachers, 
students, and parents from various urban, auburban, and rural areas 
throughout the State. These data Included both student behaviors Indi- 
cative of achievement of tba Ten Goals and teacher behaviors effective 
In helping students achieve these Goals. 

The resulting descriptions or definitions for each of the Ten 
Gosls Include: (1) Student Behaviors, (2) Rationales or narrative ex- 

planations, and (3) Teacher Strategies. Also, for each Goal QEPS has 
developed needs assessment Instruments to provide the practitioner with 
a mechanism to systematically gather Information to assess Its needs and 
assign priorities to those needs. 



Educational Testing Service. A Plan for E ^ raluatlne the Quality of 
Educational Programs In Pennsylvania "volume One: The Basic 

Program. Princeton, New Jersey; ET8, Henry S. Dyer, Project 
Director, Chapter I, pages 1-4 (June 30, 1965). 
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It is hoped that the resulting products of three years of 
intensive work devoted to defining Pennsylvania's Ten Goals of Quality 
Education will provide various segments of the educational community 
with information and the means to continue to improve the quality of 
education for the students of Pennsylvania. 
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Raymond Be r na be 1 
Assistant Superintendent 
Bucks County Schools 



Donald L* Wright 
Project Director^ QeE.P.S 
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PROJECT REPORTS 

The following is a listing and brief description of the re* 
ports produced by the Quality Education Program Study: 



Booklet A 



Booklet B 



Booklet C 



Project Description 

A description of the project including a background 
and overview and a detailed report of procedures used 
to collect, handle, and analyze the data. Includes 
an appendices. 

General Needs Assessment 
Instructions 

General Needs Assessment Instrument for the Ten Goals. 

Characteristics of Incidents and Their Reporters 
Gives a tabulation of various characteristics of re- 
porters for each category and sub-category of student 
behavior. 



Goals One through Ten each have two reports. The first is 
a D escription of the goals, containing three basic con^onents: (1) 

the categories of student behavior, (2) rationales for the areas of 
effective studenu behavior, and (3) related teacher strategies. The 
second report is related to the Needs Assessment of that goal and 
contains. (1) Instructions, (2) the general needs assessment instru- 
ment for that goal, and (3) an analysis of instruments related to 
that goal. The booklets for the Ten Goals are: 



Booklet 1 
Booklet lA 



Booklet 2 
Booklet 2A 



Booklet 3 
Booklet 3A 



Goal O ne - Self Under j^tandine 

Description 

Needs Assessment 

Goal Two - Understanding Others 

Description 

Needs Assessment 

Goal Three - Basic Sklllfl 

Description 

Needs Assessment 
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Goal Four - Interest in School and Learnine 


Booklet 4 
Booklet 4A 


Descriotion 
Needs Assessment 




Goal Five Good Citizenship 


Booklet 5 
Booklet 5A 


Description 
Needs Assessment 


Booklet 6 
Booklet 6A 


Goal Six - Good Health Habits 

Description 

Needs Assessment 


Booklet 7 
Booklet 7k 


Goal Seven Creativitv 

Description 

Needs Assessment 


Booklet 8 
Booklet 8A 


Goal Eieht Vocational Develooment 

Description 

Needs Assessment 


Booklet 9 
Booklet 9A 


Goal Nine - Understanding Human Accomplishments 

Description 

Needs Assessment 


Booklet 10 
Booklet lOA 


Goal Ten - Preparation for a World of Chanae 

Description 

Needs Assessment 
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HISTORICAL BACKGROlIMn 

In 1963 the General Assembly of Pennsylvania passed Act 299 
which contains provisions for development of evaluation procedures 
designed to measure objectively the adequacy and efficiency of the 
educational programs offered by the public schools of the CosiDonwealth 
of Pennsylvania.^ To carry out the purpose of this Act, the State 
Board of Education appointed a connlttee who in turn requested Education- 
Testing Service of Princeton, New Jersey, to develop a plan for the im- 
plementation of Section 290.1 of Act 299 . 

Education Testing Service recommended in their report Ten 
Goals of Quality Education for Pennsylvania which were adopted by the 
State Board of Education in 1965. 



1963 is a, ““ Reotsaolsatlos Jet .£ 

of this onkSUfSi"' Stsoiara., -to isiplai.at Che piicposo 

rfso^c'Td “ ptocoduro tolgned to noaeii™ objMtio”^ to 

eoabU director, aod edrtoiotretors to sore »«ltly;por.Ie. to .doc- 
tional performance and to effectuate T ™ educa 
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THF. TEN GOAT.S OF QUALITY EDUCATION POR PENNSYLVANIA 



lOAL nw R - self-understanding . 

Quality Education should help every child acquire the greatest 
possible understanding of himself and an appreciation of his 
worthiness as a member of society. 

y> AT , TOO - IWDERSTANDING OTHERS j 

Quality Education should help every child acquire understand- 
ing and appreciation of persons belonging to social, cultural, 
and ethnic groups different from his own. 



M AT. THREE - BASIC SKILLS ft.n_ 

Quality Education should help every child acquire to the full 
est extent possible for him mastery of the basic skills In the 
use of words and tiuinbersa 

MAT, wnim - INTEREST IN SCHOOL AND LEARNING 

Quality Education should help every child acquire a positive 

attitude toward school and toward the learning process. 



MAT. TTVE - ROOD CITIZENSHIP _ ^ 

Quality Education should help every child acquire the habits 

and attitudes associated with responsible citizenship. 



! OAT. SIX - GOOD HEALTH HABIK . . j 

QuaUty Education should help every child acquire good health 

habits and an understanding of the conditions n^essary for 
the maintenance of physical and emotional well-being. 

MAL SEVEN - CREATIVITir 

Quality Education should give every child 

encouragement to be creative In one or more fields of endeavor. 

MAL EIGHT - VOCATIONAL DEVELOPMENT 

Quality Education ahou l Th elp every child unde«tand the op- 
portunities open to him for prepari^ himself for a productive 

Ufe and should enable him to take full advantage of these 
opportunities* ^ 

r:nAT. NINE - UNDERSTANDING HUMAN ACCOMPLISHMEOT . ^ « 

ROAL NINE Education Shou ld help eve^T child to understand and 

appreciate as much as he can of human achievement In the 

natural sciences, the social sciences, the humanities, and 

the arts. 

GOAT. TEN - PREPARATION FOR A CHAMGING WORLD 

COAL TEN Education should help ^r y child to P«^re for a^ 

world of rapid change and unforeseeable demands In which con- 
tinuing education throughout his adult life should be a normal 
expectation* 
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The Quality Education Program Study (QEPS) proposal (to review, 
define, and clarify the Ten Goals of Quality Education) was written in 
1967. but funding was delayed until the Spring of 1968. Part of the ori- 
ginal intent has been to provide the Pennsylvania Department of Education 
with more explicit definitions to be used in their work to develop "an 
e va lu a 1 1 on procedure ”, 

While it would have been desirable for QEPS to precede the 
State's evaluation efforts, intervening events made it impossible. Dur- 
ing the interval of anticipated QEPS funding, the Bureau of Quality 
Assessment was formulated, staffed, and began the urgent task of develop- 
ing instrunents to assess the Ten Goals* 

Both QEPS and the Bureau of Quality Assessment worked coopera- 
tively to overcome the hardships imposed by reality to maximize the 
value of their related tasks to all in Pennsylvania concerned with im- 
proving the quality of the educational programs of the Commonwealth. 

Areas Involved 

The areas of Allegheny, Beaver, Bucks, Erie, Luzerne, and 
Westmoreland Counties as well as the Cities of Erie and Pittsburgh parti- 
clpated in the project. 

Sample 

Even though the sample of participants in the project was not 
intended to be a scientific sample, care was taken to have urban, sub- 
urban, and rural type districts well represented. Public, private, and 
parochial schools participated. A complete description and analysis of 
characteristics of the sample is reported in Booklet C . Charac teri s » ^ c 
of Incidents and Thetr Reporters.. 
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PROJECT OVERVIEW 



Data Collection of Student Behaviors 

This phase of the project was devoted to the data collection 
of student behaviors. The Critical Incident Technique, developed by 
Dr. John C. Flanagan, was used in this and subsequent data collections. 
This technique provides a systematic way to collect observations of 
behavior which clearly illustrate the achievement of one of the goals of 
education. Special forms for each goal were designed and field tested 
by American Institutes for Research (AIR) and the QEPS staff* 

Since direct observations of student behavior were desired, 
three groups most closely related to students were identified: teachers 

students, and parents. Critical incidents were collected in grades five 
eight, and eleven. 

Teachers were asked to record behaviors which indicated effec- 
tive and ineffective achievement of a given goal (1968-69). 

Students were asked to recall and record their own experiences 
or observation of other students which clearly Illustrated attainment 
of a goal (1968-69). 

Parents were requested to recall and record student behaviors 
which they felt were clearly illustrative of the attainment of a parti- 
cular goal (1969-70). 

Teachers, students, and parents contributed about 20,000 crit- 
ical incident reports of student behavior. 

Data Collection of Teacher Strategies 

Again, the Critical Incident Technique was used to collect 
fran teachers and students reports of effective teaching behaviors or 
strategies* 

-415 . 
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Teachers were requested to record on special forms provided 
those teaching techniques they used or observed another teacher use which 
were especially effective in helping students to achieve a particular 
goal (1969-70). 

were asked to recall an incident whereby a teacher 
helped him or another student attain one of the goals (1970-71). 

Teachers and students contributed approximately 12,000 sug- 
gested teacher strategies* 





PROCEDURES 



THE CRITICAL INCIDENT TECHNIQUE 



In his book. Measuring Human Performance , University of Pittsburgh and 
American Institutes for Research, September, 1962, pages 2, 11, and 12, 
Dr. John C. Flanagan explains the Critical Incident Technique: 

"The critical incident technique consists of a set of 
procedures for collecting direct observation of human 
behavior in such a way as to facilitate their potential 
usefulness in solving practical problems and developing 
broad psychological principles. The critical incident 
technique outlines procedures for collecting observed 
incidents having special significance and meeting sys- 
tematically defined criteria. 

"By an incident is meant any observable human activity 
Which is sufficiently complete in itself to pennit in- 
ferences and predictions to be made about the person 
performing the act. To be critical, an incident must 
occur in a situation where the purpose or intezit of the 
act seems fairly clear to the observer and its conse- 
quences are sufficiently definite so that there is little 
doubt concerning its effects. 

"Certainly in its broad outlines and basic approach the 
critical incident technique has very little which is new 
about it. People have been making observations on other 
people for centuries. The work of many of the great 
writers of the past indicates that they were keen obser- 
vers of their fellow men. Some of these writers must 
have relied on detailed notes made from their observa- 
tions. Others may have had unusual abilities to recon- 
struct memory images in vivid detail. Some may have 
even made a series of relatively systematic observations 
on many instances of a particular type of behavior. Per- 
haps the most conspicuous need in supplementing these 
activities is a set of procedures for analyzing and syn- 
thesizing such observations into a number of relationships 
which can be tested by making additional observations under 
more carefully controlled conditions. 

Background and Early Developments 

"The roots of the present procedures can be traced directly 
back to the studies of Sir Francis Galton nearly seventy 
years ago, and to later developments along the lines of 
time sampling studies of recreational activities, controlled 
observation tests, and anecdotal records. The critical in- 
cident technique as such, however, can best be regarded as 
an outgrowth of studies in the Aviation Psychology Program 
of the United States Army Air Forces in World War II. 
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Outline of The Steps In CatPc> orv FomH.^a^^«.. 

Fonmilatior^ critical requirements is called Category 

.Inilar btortor. and tha «tdarI^‘S“d«f Maln”s f 

Jtol'2X“catS«'re"i 

saaa«. «saaas,*saasy# 

analyst 1. d,«tad by bthto in stoi^njt". t 

Which are so simiSrSat fl®"'*'’ of those 

be considered duplicates State^*^t“^ puri^ses they may 
to describe each slS »ro..n V then written 

to cover the basic similarities general 
yet sufficiently SDecifle >o ®^J^® component behaviors , 
very clear. ^ ''•*® behavior involved 

Adsln, elstoutlL'^ 
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specific details consnon to some, but not all of the groups 
are omitted* This step, therefore, results in descriptive 
statements each of which incorporates a number of the 
statements obtained in the previous step* If necessary, 
this process may be repeated until the resulting state- 
ments are of a nature appropriate to the purposes of the 
study*” 



In most previous applications, the critical incident technique 
has been used to define or describe the behavioral specifics of an act- 
ivity, for which the goals or objectives were already known or assumed* 
QEPS adopted a somewhat different approach, aimed at defining in beha- 
vioral terms a set of goals which had previously been stated in rather 
general terms* It was not entirely clear at the outset how the criti- 
cal incident technique could be adapted for this somewhat different 
purpose* However, it was intended that the primary result should be a 
set of statements describing behaviors of students, that each behavior 
should constitute an instance of achievement of (or failure to achieve) 
some aspect of one of the goals of education, and that all the behaviors 
together should constitute a comprehensive definition of the goals of 
education in terms of the behavior of students* In addition, as is 
explained later, behaviors of teachers which encouraged or induced 
student achievement of a goal, were also sought* 

It should be recognized that critical incident reports of 
student (and teacher) behavior may be biased or otherwise inadequate 
for, any of several reasons* The reporter may have observed the beha- 
vior incompletely, may have re it wrong, or may have been unable 

to describe it clearly* Perhaps most important, the reporter may have 
had ah idiosyncratic coihcept of the meaning of a given goal of educa- 
tion and may have, reflected that concept in his choice, of behavior to 
report* For example, if a reporter considered good citizenship to 
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consist primarily in unthinking obedience to laws and regulations, he 
might have reported as evidence of good citizenship an instance when a 
student obeyed a rule but in the process transgressed an ethical impera- 
tive. (This is a hypothetical example; none of our reporters submitted 
such an incident.) 

The reader should, of course, keep in mind these and similar 
possible limitations of the use of the critical incident technique. How- 
ever, the strengths of the technique should also be considered, especially 
in relation to alternative methodologies. The usual method of deriving 
objectives or goals is t;o have a small group of experts develop them on 
the basis of their previous experience and discussion. These indivi- 
duals are subject to the same biases and limitations as are critical in- 
cident reporters, but they may be able to obscure their ?lmitations to 

some degree since they state the goals in rather general, non-behavioral 
terms. ‘ ' 

The reporters of critical incidents in this study were expert 
observers, at least in the sense that they were teachers, students, and 
parents actively engaged in educating or being educated. There was a 
very large number of reporters, so that their individual biases tend to 
be cancelled out. They were not allowed to take refuge in glittering 
generalities, but rather were asked to describe actual behavior of real 

students, and there is every reason to beliew that they did their best 
to do so. Finally; it should be understood that tte ^^^^ principal, 

parent, or anyone else who attempts to apply the outcomes of QEPS is n^ 

constrained to accept each and every behavioral category but may choose 

to ignore some and emphasize others. Soma specific tools to help in do- 
ing this are described in later sections. The critt 
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are thus intended to serve as a basis for precise definition of the 
behavioral meaning of various aspects of the goals of education^ but 
were never intended to constitute an authoritarian prescription of 
Just what the goals should be. 




THE USE OF THE CRITICAL I NCIDENT TECHMIOliE BY PEPS 



The Critical Incident Technique provides a set of procedures 
for collecting and utilising direct observations of specific behaviors 
which, in this study, clearly illustrate the achievement of one of the 
Ten Goals of Education. Teachers, students, and parents were asked to 
report observed student behaviors which clearly illustrated attainment 

of a goal. 



A critical incident defiries and clarifies the goal, not the 
individual student. For example. Goal Five concerns good citizenship. 

If a student obeys school rules, this is not a critical incident 

because this behavior is expected of all students. However, if the 

student obeyed school rules while other students were urging him to 

disobey these rules, then this would be a critical incident indicating 

he has acquired the habits and attitudes which characterize a good adult 
citizen* 



« viri.i.xcai incident indicates: 

i. Something the student has done or failed to do which 
a clear example of attainment or lack of attain- 
roent of one of the Ten Goals* 
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^i tJStiSn!** description of the facts in the 

Something a student did or said which was actually 

observed by the reporter* ^ 

4. Behavior which should be praised or which needs to be 
improved to attain this educational 

If a student behavior is a part of everyday expected class- 
room standards, then it is n^ a critical inkdent;-^^ 

An example of an observed critica 1 incident in wliich a s tu- 
dent , demonstrated creativity is: >ry brought a poem to school that 



I 

I she had written which showed unusual insight into children's views on 

I values." On the other hand, the statement, "Mary did may things that 

I showed she was creative," is not a critical incident because it does 
not refer to and describe a specific critical behavior. 

PROCESSING OF DATA . . 

The collected incidents were transcribed onto coded cards in 
each QEPS office, reviewed, and the key behavior highlighted before for- 
warding the incident cards to the AIR office in Pittsburgh. There the 
cards were used to inductively build a classification scheme of (1) 

I student behaviors and (2) teacher strategies . A third aspect of the 
definition of the Ten Goals is rationale for the student behaviors, 
tying together the description and application of each behavioral des- 
cription* 
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PgSCRimoW OF DATA CQT.lecTION PROTEmippc 
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vlor In two nays. First, each teacher was asked to recall and des- 
cribe recent InaUnces of appropriate student behavior (retrospective 
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alert to the occurrence of relevant Incident and write description. 

en as soon as feasible after they happened (current Incidents), it 
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the sane In developing the behavlorel categories. 
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As it turned out, they were not substantially different; hence, analysis 
of these incidents was terminated as soon as that conclusion could be 
reached* 

Special versions of the incident forms were provided for stu- 
dents and parents* The main difference between these, forms and those 
used for teachers was that the language was simplified* Also, only ef- 
fective incidents were requested, since it was feared that there might 
be cases of misunderstanding in which ineffective incidents would be 
considered disapproving of the particular children involved* 

The second aspect of goal definition, teaching strategies, 
also utilized the critical incident technique to collect teacher beha- 
viors* Teachers were asked to report strategies or techniques which 
they used or which they had observed another teacher use* These strate- 
gies were felt to be effective in helping a student achieve one of 
Pennsylvania's T^n Goals of Quality Education* Students also were asked 
to recall when they observed a teacher use a strategy or a technique ef- 
fective in helping him or another student to achieve one of the Ten Goals 
The forms used for both students and teachers were basically the same* 






HOW THE DA TA WERE HANDLED AND AWAt.V7Rn 

As critical incidents were collected, they were transcribed 
onto five-by-eight inch cards; then reviewed by the Q.E.P.S. staff and 
the key behavior on each card was highlighted. The analysis of critical 
incidents was then carried out by a research team at A.I.R. by grouping 
similar incidents into categories. The analyst did not begin with a 
predetermined set of categories, but rather attempted to induce cate- 
gories which describe the behaviors reported in the incidents. These 
categories, though not quite so specific as the incidents, were stated 
in behavioral terms • 

Marram of Development of B ehavioral Spectftcatfmifl 



Teachers Critical Incidents 
Students ( Student ) 

Parents (Behaviors) 



Categories 

of 

Behavior 



Areas 

of 

Behavior 



Goal 



Perhaps an examination of this procedure using CRITICAL 
INCID0JTS actually reported for Goal One would serve to illustrate the 

process of behavioral specification. 

Goal One: QUALm EDUCATION SHOULD HELP EVERY CHILD ACQUIRE 

OF HIMSELF AND 

AN APPRECIATION OF HIS WORTHINESS AS A MEMBER OF 
SOCIETY. 
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SAMPLE 

CRIllCAL INCIDENT 



SAMPLE 

CRITICAL INCIPEHr #2 



A Teacher Reporting a Fifth Grade Student 
Behavior ; 

1. Setting? 

DURING A CLOTHING CLASS WHEN A FASHION 
SHOW WAS BEING PUNNED. 

2. Student Behavior? 

QUIET WELL-MANNERED GIRL OFFERED TO 
DEVELOP A SCRIPT FOR THE FASHION SHOW 
AND COORDINATE THE OUTFITS ACCORDING 
TO THE SCENE. SHE PREFERRED TO TAKE 
PART IN THIS BECAUSE SHE WAS UNUSUALLY 
LARGE FOR HER AGE AND QUITE HEAVY. 

3. ExplaTOtlori? 

SHE REALIZED SHE HAD THE ABILITY TO 
WORK ON THE SHOW AND THE OUTFITS AND 
THOUGHT HER TALENTS WOULD BE PUT TO 
BETTER USE RATHER THAN TO BE USED AS 
A MODEL WHEN SHE FELT UNSUITABLE FOR 
THE STAGE. 



^ Student Reporting a Fifth Grade Student 
Behavior; 



ERIC 



1. Setting? 

IN SCIENCE » WHEN SHE WAS DOING GROUP 
WORK ON THE STUDY OF ATOMS. 

2. S tudent Behavior ? 

SHE HELPED DO REPORTS INSTEAD OF DRAW- 
ING ILLUSTRATIONS, AS SHE WAS POOR AT 
DRAWING. 

3. Explanation? 

SHE LET OTHERS DO ILLUSTRATIONS, AL- 
THOUGH SHE DID LIKE TO DRAW, BECAUSE 
HER DRAWING WAS POOR, BUT SHE DID 
HELP WRITE REPORTS, WHICH SHE COULD 
':,' -DO WELL. 

Both of these Incidents are grouped and characterized by the following 
statement which Is called a CATEGORY of behavior; 
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[ SAMPLE 

CATEGORY #1 






STUDENT CHOSE AN ACTIVITY OR TASK SUITED 
TO HIS ABILITIES IN PREFERENCE TO ONE TO 
HIS ABILITIES. 



Examples of other similar, but distinct, categories derived from critical 
incidents are : 



SAMPLE 
CATEGORY #2 



SAMPLE 

CATEGORY 



STUDENT AVOIDED AN ACTIVITY NOT SUITED TO 
HIS ABILITIES OR HIS GOALS. 



STUDENT RECOGNIZED BOTH A POSITIVE AND A 
NEGATIVE PERSONAL QUALITY, ABILITY. OR 
INTEREST IN HIMSELF. 



The essence of the ideas expressed in the categories are then used in 
deriving the AREA HEADINGS . 

The above sample categories are subsumed under the AREA HEADING ; 



SAMPLE 

AREA HEADING 



STUDENT DEMONSTRATED THAT HE HAS CAPABLE 
OF ACCURATE SELF- APPRAISAL. 



Thus, within each of the goals of education, there would normally be 
several areas; within each area there would be several categories of 
behavior, each category representing and summarizing the behaviors re- 
ported in a number of critical incidents. The end result is an organized 
category scheme which describes in a comprehensive way the critical inci- 
dent data* This is depicted below: 



More General 



I 



GOAL 



AREAS 






CATEGORIES 



More Specific 



CRITICAL 

INCIDENTS 
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Numbering of the Category Scheme 

Each area, category, and sub- category is assigned a code num- 
ber within the goal. For example, the first area In Goal One would be 
coded "1.0", the first category within the first area "1.1", and the 
first sub-category In the first category "1.1-1". The only hierarchy 
Intended by the coding system Is to Indicate level of generality from 
area to category to sub- category. No hierarchy of Importance or prior- 
ity Is Intended. 




p 



RELIABILITY STUDY OF STUDENT CATEGORIES OF BEHAVTOW 

Purpose 

The category system of student behaviors for the Ten Goals of 
Quality Education was induced from the approximately 20,000 critical in- 
cidents collected from teachers, students, and parents. Staff members 
from American Institutes of Research (AIR) with the help of Q.E.P.S. 
spent over a year in developing the current set of categories. 

To test the ability of the categorizers to express the ideas 
contained in the incidents and the extent to which the categories are 

mutually exclusive were the purposes of the reliability study. Some 

problems were anticipated because of several rules which were imposed on 
the categorizers. First, categories were to be as faithful as possible 
to the spirit of the incidents. No categories were to be developed with- 
out incidents to back them up. The sheer size of the category system it- 
self presents problems. 

Design of The Study 

The staff of AIR selebted a stratified random sample of approx- 
imately 100 effective incidents and 50 ineffective incidents for each of 

the Ten Goals. Each of the selected incidents had previously been cate- 
gorlzed by the AIR staff. 

Thirty raters from the Pennsylvania Department of Education 
participated in the reliabili ty study. Three raters were assigned to 
each goal and were asked independently to place each incident in a cate- 
gory. Participants were given two weeks to complete the task. IWenty- 
seven of the participants responded and all results are based on their 



i ' • 

responses* 

Analysis of Responses 

Percentage agreement of the participants with AIR was calcu- 
lated and Is reported In tables one and two* 

For the effective categories the average percentage agreement 
ranged from 3^.6% In Goal Seven to a high of 69*7% In Goal Six* Eight 
I of the ten averages were above 50% and three were at least 60% In agree- 

ment with AIR* 

For the Ineffective categories average percentage agreement 
ranged from 49*3% In Goal One to 73*3% In Goal Four* Nine of the ten 
; averages were above 50% and five were at least 60% In agreement with 



AIR* 
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^BLE ONE EFFECTIVE CATEGQRTRS 

Percentage Agreement of Three Raters with AIR 



Goal 1 


100 


A 

66 


a 

65 


C 

48 


Mean 

so 7 


Goal 2 


101 


65.3 


44 a 6 


’ *T0 

57.4 


53 5 


Goal 3 


100 


53 


62 


65 


60 o ' 


Goal 4 


100 


52 


53 


62 


OveU 

55 7 


Goal 5 


100 




67 


68 


67 c 


Goal 6 


ioo 


72 


77 


60 


60 7 


Goal 7 


102 


48.0 


29.4 ' 


35.3 


37 6 . ’ 


Goal 8 


100 




57 . 




57 


Goal 9 


100 


58 


50 


60 


56 


Goal 10 t 


100 


39 


20 


66 


JO 

-^1.7 










TABLE TWO INEFFECTIVE CATEGORIES 

Percentage Agreement of Three Raters with AIR 



Number of 

Goal/Ineffectlve Incidents ' A B C _ Mean 



Goal 1 


56 


50 


52 


40 


49.3 


Goal 2 


50 


72 


64 


64 


66.7 


Goal 3 


50 


52 


54 


58 


54.7 


Goal 4 


50 


76 


78 


66 


73.3 


Goal 5 


51 


: 


70.6 


64.7 


67.6 


Goal 6 


49 


67.3 


73.5 


73.5 


71^ 


Goal 7 


50 


64 


52 


46 


54 


Goal 8 


50 




66 




66 


Goal 9 


50 


54 


46 


56 


52 


Goal 10 


50 


40 


56 


80 


58.7 




^scusston of Reaultia 



Initial expectations at the outset of the reliability study 
was an agreement of 60%-70%. Only two Individuals out of the 27 that 
completed the effective Incident categorisation agreed above that level 
In fact, no average for a goal came up to that level (although Goal Six 
comes close at 69.7%). What are the reasons for this? 

Three general variables have been Isolated to understand the 
meaning of the results: (1) the raters. (2) the Incidents, and (3) the 

category system. Each of these will be considered In turn. 

The raters from the Department of Education were, of course, 
unfamiliar with the QEPS project and with the particular procedures of 
the reliability study. It was perhaps too difficult an assignment to 
expect these individuals to be able to Interpret the Incidents, the 
rather complex category scheme, and relate these to the Instructions 
for the reliability study. The task was also more time-consuming than 
was probably anticipated by many of the raters. Hence, it should per- 
haps not be surprising that some errors were made by the raters. Includ- 
ing even the assignment of non-exlstlng category numbers to a few Incl- 
dents • 

The nature of the Incidents themselves, too. had an influence 
on the overall agreement of the raters with AIR. Several specific In- 
cidents where agreement was low were examined. The reason for AIR's 
categorization was easily understood, but because of differences in 
Interpretation or possible ambiguities of language, the reasons for the 
raters categorizing the Incident differently were plausible as well. 

Finally, the size of the category system and the time required 
to learn some of the subtleties of differentiation between categories 

- 2^4 



probably Influenced the percentage agreement. 

In addition to the size of the category system there Is the 
additional problem of level of specificity of the categories. Some of 
the categories are quite specific while others are more general and en- 
compass several smaller classes of behavior. Placing the appropriate 
limits on the category may be more difficult than was originally thought. 

Although the reliability study was not considered an end unto 
Itself the discussion here has shown that the study has been useful In 
describing some of the characteristics of the category system. There 
ate some limitations to the category system, most of them probably as- 
sociated with the ambiguities and subtleties of language. 
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TEACHER STRATEGIES 



Tile procedure described for developing a category scheme of 
student behaviors is also used to derive categories of teacher strat* 
egies. Again, an examination of selected CRITICAL INCIDENTS , a cate- 
gory, and an area derived in this study serve to illustrate this proce- 
dure: 



Goal TWo: QUALITY EDUCATION SHOULD HELP EVERY CHILD ACQUIRE 

UNDERSTANDING AND APPRECIATION OF PERSONS BELONG- 
ING TO SOCIAL, CULTURAL AND ETHNIC GROUPS DIFFER” 
ENT FROM HIS OWN. 



SAMPLE 

CRITICAL INCIDENT tfl A GRADE EICHT TEACHER 

1 . Setting? 

DURING PIIYSICAL EDUCATION CLASS, TWO 
BOYS, ONE BUCK, ONE WHITE, ARGUED OVER 
LOSING A BASKETBALL GAME. WORDS WERE 
EXCHANGED WHICH DEGRADED THE BUCK STU- 
DENT BECAUSE OF HIS RACE. 

2. Teacher Behavior? 



I SPOKE TO BOTH THE BOYS DURING THE FOL- 
LOWING CUSS, DISCUSSED THEIR DIFFERENCES 
AND TRIED TO MAKE THEM REALIZE THAT FEOr 
PLE CAN TOLERATE AND UNDERSTAND DIFFER- 
ENCES. DURING THE FOLLOWING MONTHS I 
MADE IT A POINT TO HAVE THE BOYS WORK TO- 
GETHER ON THE SAME TEAM, SQUAD, ETC. 



3. Explanation? 

I SEE AN IMPROVEMENT IN THEIR ATTITUDE 
TOWARD EACH OTHER, AND IN TIME, IT MAY 
IMPROVE EVEN MORE. BOTH STUDENTS WERE 
CONFRONTED WITH THEIR ATTITUDES AND WERE 
MADE TO SEE THAT DIFFERENT RACES CAN 
UNDERSTAND EACH OTHER AND WORK AND PUY 
TOGETHER. 




SAMPLE 

CRITICAL INCIDENT #2 A GRADE ELEVEN TEACHER 

1. Setting? 

PARTiaPATION IN TEAM GAMES. SOME OF 
THE BLACK STUDENTS WOULDN'T DO THEIR 
BEST UNLESS MOST OF THEIR TEAM WAS BLACK. 

2. Teacher Behavior? 

I TOOK SOME OF THE BETTER WHITES AND 
MIXED THEM WITH THE BLACKS. 

3. Explanation? 



THIS SHOWED THE BUCKS THAT SOME OF THE 
WHITES WERE VERY TALENTED ALSO AND THAT 
THEY COULD WIN TOGETHER AS A TEAM. 



These incidents are represented by the more generalized CATEGORY ! 



SAMPLE 

CATEGORY TEACHER ENCOURAGED OR MADE OPPORTUNITIES FOR 

STUDENTS TO FLAY, WORK, OR GET TOGETHER WITH 
THOSE WHO ARE DIFFERENT OR WITH WHOM THE 
STUDENTS WOULD NOT NORMALLY ASSOCIATE. 



Another related CATEGORY teacher behavior Is: 



SAMPLE 

CATEGORY #2 TEACHER ASKED OR ENCOURAGED STUDENTS TO AID 

PERSCRtS WHO WERE NOT KNOWN lERSONALLY BY 
THE STUDENTS. 



Both of these categories are characterized by a more general, more Inclu- 
sive AREA statement: 



SAMPLE 

AREA HEADING TEACHER ENCOURAGED DIRECT FACE-TO-FACE INTER- 

ACTION OR INVOLVEMENT BETWEB< STUDENTS WHO 
ARE DIFFERENT FROM EACH OTHER. 
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The category scheme of teacher strategies resulting from this inductive 
classification procedure provides a more generalized set of teacher 

behaviors which communicates in a comprehensive way the critical inci- 
dent data. 
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1 

RATIONALES FOR AREAS OF STUDENT BEHAVIOR 

Utilizing the student and teacher behavior specifications, the 
QEFS staff wrote rationales for each Area of student behavior to complete 
the definition of the Ten Goals of Quality Education* 

The rationale is an attempt to explicate the reasoning connect- 
ing the critical incident data to the application of the results in the 
schools* Each rationale has three parts: description, analysis, and 

application* 

The description is a statenent of the characteristics of the 
behaviors in the incidents which comprise the category* The analysis 
section attempts to analyze the psychological and educational implica- 
tions of the behaviors and attempts to provide a bridge between the 
description and the application sections* The application part of the 
rationale attempts to describe the educational implications of the 
category including suggested related effective or ineffective teaching 
techniques • 
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I 

DATA PROCESSING | 

A Description of Incidents and Their Reporters I 

A "Teacher Data Card" was completed by each teacher who parti- 
cipated in the study. On the card is reported the teacher's sex, marital 
status, race, age, years in the district, total years of teaching ex- 
perience, education, and areas of certification. Each Teacher Data Card 
also contains a number designating the County, District, Grade, and 
Teacher* 



The Incident Card", on which each critical incident i« trans- 
cribed, also has the County, District, Grade, and Teacher number of the 
reporter. After an incident has been placed into the proper category 
or sub-category of student behavior, that number from the category scheme 
is written on the upper right-hand corner of the Incident Card. 

After all the coded information from Teacher Data Cards and 
Incident Cards is placed in computer memory, the Teacher Number on each 
Incident Card is then matched with the Teacher Number on the Teacher 
Data Card. From this information are prepared reports of the various 
characteristics of the reporters of each category and sub-category of 
student behavior. These reports are contained in Booklet C. 
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NEEDS ASSESSMENT 



From the critical incident data and resulting categories of 
student behavior QEFS developed a general and individual needs assess* 
ment Instrument for each of the Ten Goals. The overall Intent is to 
provide a school or district with the means to take the definitions of 
the Ten Goals generated by QEFS and use them directly to assess its 
needs and establish priorities among the Ten Goals and areas within the 
Goals. 

The General Needs Assessment Instrument was produced by writ- 
ing a capsullzed heading for each area of student behavior for the Ten 
Goals. Then categories and sub- categories exemplifying the area were 
selected and rewritten at an elementary level of reading difficulty. 
These statements were then formatted with a five- point rating scale 
ranging from "most important" to "least important". 

The Individual Needs Assessment Instrument utilizes the same 
capsullzed area headings contained in the General Needs Assessment 
Instrument . Under each heading each category was rewritten to, again, 
simplify the language and readability. The Intent of this Instrument 
Is to extend the usefulness of the general instrument. The focus here 
Is on the Individual student. A five-point scale Is used to determine 
frequency of a given behavior by the student, from "always" to *Vtever". 
This Instrument can be used by the student as a self-evaluation, by the 
teacher or the parent. 

The last section of the Needs Assessment booklet contains An 
Analysis of Instruments . Each Instrument was Identified logically as 
It related to the goals of Quality Education. This task was accomplished 




by teams of consultants from the University of Alabama and the University 
of Nevada, Las Vegas. The procedures used in the instrument selection 
process are explained in each of the Needs Assessment booklets. 

f 



PROJECT REPOtTS 



The following is a listing and brief description of the re- 
ports produced by the Quality Education Program Study: 



Booklet A 



Booklet B 



Booklet C 



Project Description 

A description of the project including a background 
and overview and a detailed report of procedures used 
to collect, handle, and analyze the data. Includes 
an appendices. 

General Needs Assessment . 

Instructions 

General Needs Assessment Instrument for the Ten Goals. 

Characteristics of Incidents and Their Reporters 
Gives a tabulation of various characteristics of re- 
porters for each category and sub-category of student 
behavior. 



Goals One through Ten each have two reports. The first is 
a Description of the goals, containing three basic con^onents: (1) 

the categories of student behavior, (2) an analysis of the areas of 



effective student behavior, and (3) related teacher strategies. The 



second report is related to the Needs .:>3sessment of that goal and 
contains: (1) Instructions, (2) the general needs assessment instru- 

ment for that goal, and (3) an analysis of instruments related to 



that goal. 


The booklets for the Ten Goals are 
Goal One - Self Understanding 


Booklet 1 


Description 


Booklet lA 


Needs Assessment 




Goal Two - Understanding Others 


Booklet 2 


Description 


Booklet 2A 


Needs Assessment 




Goal Three - Basic Skills 


Booklet 3 


Description 


Booklet 3A 


Needs Assessment 
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Goal Four - I nterest tn School nnd Learning 
Booklet 4 Pescrtotlon 

booklet 4A Needs Assessment 



Goal Five * Good Citizenship 
Booklet 5 Description 

Booklet 5A Needs Assessment 

Goal Six - Good Health Hahitfl 
Booklet 6 Description 

Booklet 6A Needs Assessment 

[ Goal Seven - Creativity 

Booklet 7 Description 

Booklet Needs Assessment 

Goal Ei ght - Vocational Development 
Booklet 8 Description 

Booklet 8A Needs Assessment 

goal Nine - Understan ding Human AccolnDltahlnl.n^«. 
Booklet 9 Description 

Bookie t 9A Needs Assessment 



Booklet 10 
Booklet IQA 



Goal Ten - Preparation for a World of nhan ai. 

Description 

Needs Assessment 
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APPENDIX 



Sample Teacher/Student Crl!:tcal Inc^c^l.n^ F«.-m 



G oal 1 ; Quality Education should help 
“ ®very child acquire the greatest possible 

J understanding of himself and an appre- 

ciation of his worthiness as a member of 
society. 

demonstrated good JSeJjjJnSS S^hJ^eulnJ 
What was the student's grade level? 



What were the circumstances under which this occurred? 



Just what did the student do? 



“"■^'“ood ,.d .ppre- 



S^ttiPnt tn Interviewer of TMdii>r« to Elicit incldenta of TMchi.r 



1. A general description oC the project and of the reasons (or teacher 
participation should of course be presented first* In describing the 
project, too points should be kept in sdnd: 

a. Sooe or all of the teachers say have participated in the Teacher^- 
on>Student or Stodent>on>Stodent Collection last year, and nay 
reaeaber soaething about the project. 

b. If you are to collect General or Open-Ended incidents (i.e., those 
not necessarily related to any of the ten goals), you should not 
aention any specific goal of education until after the General 
incidents have been collected. 

2. If you are to collect General (Open^nded) incidents, give each teache 
a blank incident fora of the appropriate vpe. Head aloud the entries 
on the fora, discussing each briefly. If necessary, a saaple incident 
aay be presented, but the specific goal to which the incident applies 
should not be aantiooed. Then ask the teachers to write an incident o 
the fora. 

3. If you are to collect goal-specific incidents on our Regular Fi»ra, a 
brief discussion of the ten goals should be presented. Then give each 
teacher a blank incident fora, read aloud the entries, and discuss eac 
briefly. Ask the teachers to write an incident on the fora. When 
feasible, it is best to work with one goal at a tise, but it will prob 
ably be necessary on soae occasions to either (a) ask each teacher to 
supply incidents on a»re than one goal, or (b) ask groups of teachers 
to provide incidents on different goals. 

4. Alloe tiae for <tuestions about the procedure. If tine petaits, ask 
the teachers to write additional incidents. When the allotted tiae 

is alaost up, provide additional foras and ask that these be cnapleted 
so that you can collect thea on your return visit in about a week. 
(Specify the tiae of the return visit as accurately as possible.) 
Regular (Goal Specific) and General (Open-^nded) foras could not be 
used with the saae groi^t of teachers to be conpleted during a given 
week. 







g awpic Tfftthgr/Teacher Critical Ine^d«ln^ fym , 



Coal 2 ; 



Quality Education should help every child acquire understandlna 
ai^ appreciatim of persons belonging to social, cultural and 
ethnic groups different fron his own. 



«i«i. ,,0^. 



Wi.l mde I..S th. .tndoic taJ Clrcli ; Mil. r»«il. 

subjfefct lit wHi.ich the incident occtirrctls 

Math Social Studies Art>Husic Foreign Language Other 

Science Unguage Arts Phys.Ed. Health Industrial Arts Outside 

Classroom 

What were the circunstances under which this incident occurred? 






teacher’s action helped the student 

*'iifl®i*‘’^j“‘***®*^®“**^^*** appreciation of {wrsons bn^itina to social 
cultural, and ethnic groups different frost his own? “‘"**‘*‘* “ aocial. 



If the above incident involves another teacher, please circlet Hale Fessile 



¥7 



Suagestlona for Interviewer of Students 



(Introduce yourself If ch^ teacher or principal has not already done so.) 



Say: "YOUR SCHOOL IS tIELPIIfG O* A PROJECT TO FIND OUT VHAT THE COALS OF 

EDtJCATlOH SUOOLO BE. WE ARE ASRIMC PARSmTS, TEACHERS, AHD STU>Eirr£ 
TO TEU. US ABOUT TUI.IGS THEY HAVE ACTUAIXY SEEN." 



(For Fifth Crade Students: ) 

( ) 

( ) 

(Say: "HERE IS A FORM WHICH TELLS ABOUT ONE RHIO OF GO/d. FOR EDUCA* ) 

( TICN. L£T*S READ IT TOGETHER." ) 

( ) 

(Give each student a copy of the saaiple Incident fom* Read the es* ) 

(sentlal naterlal aloud, pointing out the parts that represent the ) 

(saaiple Incident and also pointing out that the incident adght be ) 

(about the student hlnself. ) 



Then, as you give each student a blank Incident fomi for the designated 
goal, say: "HERE IS A FOUl WHICH TEU.S ABOUT ORE (AROTHER) GOAL. LET'S 

READ THE FIRST PART OP IT TOi^THER." (In the case of goal 6, say: 

"SERE IS A BLANK FORM," and do net read the Introductory naterlal.) 



Read the Introductory naterlal (prior to *Vhat was the student's grade?”) 
Then say: "FILL IN THE STOilERI'S CRAW AND CIRCIE MALE OR FEMALE. HART 
TIMES WRITIRG ORE INCIDBIIT WH1. HELP TOU THINK OF AMOTHER, SO WHEN TOO 
have COKPtETEO ONE FORM RAISE TOUR HAND AND 1 Will. GIVE TOO ANOTHER. 

TOD FIU. OUT THE FORM BT TEtLINC ABOUT SaNBTBtRG TOD OR ANOTHER STUDENT 
DID." 



If any student cannot think of an Incident, reassure him that there is 
nothing vrong in this and thank hin for his efforts. 







Every young person should Icsm to know hlBself so rKar Un «««•* u 



What was the student's grade? _ 
When and where did this happen? 



Circle: Male 



Fesale 



Just what did the student do to show that he understood hls»elf7 



( How did this show that the student understood hioself? 

j 

i, 

I 

\ 

i 

I 
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i 
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I 
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Sumteatlons for Interviewer of Parenta 



(Introduce youreelf If the meeting chairman has not already done so.) 

Say: 

"THE QUALITY EDUCATION FROCRAM STUDY IS BEING CARRIED OUT BY SEVERAL SCHOOL 
DISTRICTS IN PENNSYLVANIA. THE STUDY IS SUPPORTED BY FEDERAL FINDS. THE 
PURPOSE OF THE STUDY IS TO CLARIFY THE COALS OF EDUCATION AND, IN THE LONG 
Rtm, TO HELP EACH SCHOOL TO DETERMINE HON HELL IT IS ACHIEVING THESE GOALS. 
"ONE HAY HE ARE STUDYING THE GOALS OF EDUCATION IS BY FINDINC OUT HHAT YOUR 
CHILDREN DO TO SHOH THAT THEY ARE ACHIEVING CERTAIN GOALS. HE ARE ASKING 
TEACHERS, STUDENTS, AND PARENTS TO TELL US ABOUT SPECIFIC OCCASIONS HHEN 
STUDENTS HAVE SHOHN ACCOMPLISHMENT (ff AN EDUCATICHAL GOAL." 

Paaa out a blank form for one goal to each parent, and aay: 

"LET US READ TIBOOSH THIS FORM. THE FIRST PART ASKS FOR INFORMATION ABOUT 
TOO. THE NEXT PARAGRAPH DESCRIBES A COAL OF EDUCATION.” 

Read the form aloud, comoKntlng briefly on the function of each part and 
ea|>ha8i2ing that reports of behasior are desired ("just what did the child I 
d£ • • •?}« then aek the intents to complete the fom. Offer en additional | 
fora to each perent ae you see that he has coo^leted one# | 

I 

*««««« I 

i 

Anwera to llfcelT oueationa ! \ 

t 

Ht Can the child reported on be in any grade? | 

'I 

A: Yes, although we would prefer Sth grade and aboee, since the younger | 

children smy not be mble to show progreas toward aooe of the goals. j 

Q: Do yon want instances of failure to achieve the goal? 

A: Not at this tiae* We have obtained sose reports like that from 
teachers and out initial analysis shoes that we are likely to get 
sane value from positive reports. 



3 Sb 



* 



PARENT 

INFORMATION: 



Circle; 

Male 

Female 



Check Highest E ducational Level Completed : 
Loss than High Post College Postgrad- 

Crade 12 School H.S> Degree uate Work 



understand himself. He should know the 
“D do well, and the things that are difficult for him. 
It is also important that he see himself as a worthy person. 

IhnJ ocMsion when you observed either your child or another 

showed that he understood his unique talents and 
limitations, and his worth as an individual. 



What grade was the child in? 

When and where did this happen? 



Circle ; Male 
Female 



Just what did the child do to show that he understood himself? 



I How did this Incident show that the child understood himself? 



i I 
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Student/Tearher Collection 
SUGGESTIONS FOR IMIERVIEUER OF STUISNIS 
(After class has been ttimed over to you) 



The following Is a suggested approach in working with this collection: 
Say: "WE /JIE WORKING WITH TEACHERS, PARENTS AND STUDENTS OM A 

RESEARCH PROJECT DEALING WITH GOALS OF EDUCATION. , 

"WE WOULD LIKE YOUR HELP TODAY IN RECALLING SOMETHING A 
TEACHER DID OR SAID THAT HELPED YOU OR ANOTHER STUDENT WITH A 
GOAL THAT IS STATED ON THE PAPER I'M GOING TO GIVE YOU K(W. 
PLEASE DON'T WRITE ANYTHING UNTIL WE'VE READ THE PAPER TOGETHER 
AND ANSWER ANT QUESTIONS YOU MAY RAVE." 



1. Read co^ilete fons to the class, direct the filling in of the t^>per 
portion of the fora, answer questijns. 

Special Hote l On the font where it says: "Circle for Student: Male 

Fesal 

ask the student to circle his/her ffin ae^. 

2. Provide exasq>les only as a last resort to elicit responses. 

Exasqtles frosi other students are often tsore beneficial than froa the 
interviewer. 
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education is for each student to learn to understand 
himself. Evenr ywng person should know the things he likes and the thlnns 
he can do wdl. He should also know what he can’t do well, but he should^ 
remember that his strong points are more important than his weak points. 



A teacher can sometimrs help a student to understand himself. 

Si; ;s.”" * tt»i i,dp.d 



Think of 
you or an- 



What grade was the student in at the time? 



When and where did this happen? 



Circle for student: Male 

Female 

Circle for teacher: Male 

Female 



Just what did the teacher do to help the student understand himself? 



How did this help the student to understand himself? 



O 

ERIC 
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